2023-10-07 14:56:37.AIbase.1.8k
GPT-4 Becomes a Reviewer for Nature? Stanford and Tsinghua Alumni Test Paper Shows Over Half of the Review Comments Match Human Reviews
Stanford researchers found that GPT-4's review comments for Nature and ICLR papers matched human reviews over 50% of the time. Researchers inputted the PDF of a paper into GPT-4 to obtain review comments, which were then compared to human feedback. The similarity of GPT-4's reviews was over 82%, with authors believing the comments were helpful. Compared to humans, GPT-4 paid more attention to the paper's impact factor and showed less concern for ablation studies. Users generally believe that GPT-4's feedback could improve accuracy and reduce the workload of manual reviews.
